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FIG. 2A 



200 







<litml> 
<liead> 

<title>lnternal Annotation Example</title> 






<body> 




210 <p>Here is the first sentence. 




220 


<!- 

<?xnnl version="1.0" encoding="ISO-8859-1"?> 

<annot version="1 .0"> 

<remove/> 

</annot> "^^230 
— > 




240 


<p>And here is another sentence. 
<b>Hello world.</b> 

</body> 
</html> 
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FIG. 2B 
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<html> 
<heacl> 

<title>lnternal Annotation Example</title> 
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<body> 

210 <p>Here is the first sentence. 

</bocly> 
</html> 
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FIG. 5A 



500 



SO 



<?xml version="1 .0" encocling="ISO-8859-1"?> 
"<annot version="1 .0"> 

<comment>External Annotation Example 1</comment> 

510 <clescription take-effect="after" target='7HTML[1]/B0DY[1]/*[1]"> 

<remove /> 
</desGription> 
</annot> 



FIG. 5B 



550 



<html> 
<heacl> 

<body> 

<p>Here is the first sentence. 

<p>And liere is another sentence. 
<b>Hello world.</b> 

</body> 
</htnnl> 
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FIG. 7 A 

700 





<?xml version='1.0' ?> 
<annot version="1 .0"> 




710 




<clescription take-effect= 

<remove /> 
</description> 


"before" target="/HTML[1]/BODY[1]/*[1]"> 


T'>/> 

72U 




~<description take-effect= 
<keep /> 
</description> 


"before" target="/descendant: :TABLE[1 ]"> 


730 




'~<description take-effect= 
<remove /> 
</description> 


"before" target="/descendant: :TR[2]"> 




</annot> 
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<html> 
<head> 

<TITLE>A Simple Example To Illustrate Table Scoped Clipping</TITLE> 

</head> 

<body> 

— <H1>HTML is Easy To Leam</H1> 
^<TABLE> 
<TR> 

<TD> Cars</TD> 
<TD> Colors</TD> 
<TD> lnteriors</TD> 
</TR> 



<TD> 2 Door</TD> 
<TD> Red</TD> 
<TD> Leather<n'D> 
</TR> 
</TABLE> 

<P>WelGome to the world of HTML. 

This is the first paragraph. While short it is 

still a paragraph!</P> 

<P>And this is the second paragraph. </P> 

</body> 

</html> 



FIG. 7B 
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FIG. 7C 

760 



<html> 
<head> 

<TITLE>A Simple Example To Illustrate Table Scoped Clipping</TITLE> 

</head> 

<body> 

<TABLE> 

<TR> 

<TD> Cars</TD> 
<TD> Colors</TD> 
<TD> lnteriors</TD> 
</TR> 
</TABLE> 

<P>Welcome to the world of HTML. 

This Is the first paragraph. While short it is 

still a paragraph!</P> 

<P>And this is the second paragraph.</P> 

</body> 

</html> 
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FIG. 8 



800 

<?xml version- 1 .0' ?> 
<annot version="1 .0"> 

-<clescriptiontarget='Vclescendant::P[clescenclant::text()[contains(.,'IBM')]]"> 

< take-effect-before> 

<push/><keep/> <remove tag="IMG" /> 
</take-effect-before> 

< take-effect-after> 

<pop/> 

</ take-effect-after> 
</description> 

</annot> 
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FIG. 9A 

900 





<?xml version- 1 .0' ?> 






<annot version="1 .0"> 






<description take-effect="before" target="/descendant::F0RM[1 ]"> 






<replace> 








<form> 








<text>NEW prompt for INPUTTEXT3(now a select)</text> 








<field name="INPUTTEXT3" type="SELECT"> 








<option value="No" label="No." /> 








<option value="Yes" label="Yes." /> 








<option value="Maybe" label="Don't Care" /> 




910 


920 


</field> 








<text>NEW prompt for INPUTTEXT2</text> 








<field name="INPUTTEXT2" value="bottle washer" /> 


■:. i 

-~i 






<field name="INPUTTEXT1" value="Bob Jones" type="HIDDEN" /> 


py 






<field type="SUBMIT" /> 








</form> 






</replace> 






</description> 






</annot> 
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FIG. 10 

1000 

<?xm! version- 1.0' ?> 
<annot version="1 .0"> 

^descrlptiontarget="/descendant::IMG[globb-search(@src,'*.{jpg,gif,pngn"> 

< take-effect-before> 
<push/> 
<replace> 

<text> ..PIC. </text> 
</replace> 
</take-effect-before> 

< take-effect-after> 
<pop/> 

</ take-effect-afler> 
</description> 

</annot> 
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FIG. IIB 

1150 



<HTML> 
<HEAD> 

<TITLE>External Ano</riTLE> 

</HEAD> 

<BODY> 

<B>Hello world.</B> 
<TABLE> 

<TR><TH>Cars</TH><TH>Colors</TH><TH>lnteriors<rrH></TR> 

<TR><TH>2Door</TH><TH>Red</TH><TH>Leather</TH></TR> 

<TR><TH>4Door</TH><TH>Blue<n"H><TH>Cloth</TH></TR> 

<TR><TD>Convertible</TD><TD>Black<n"D><TD>Vinyl<n"D><n"R> 

<n"ABLE> 

Remove This text. 

<TABLE> 

<TR><TH><B>Warranty</B></TH><TH><B>Length</B></TH> 

<TH>Restrictions</TH> 
</TR> 

<TR><TH>Si!ver</TH><TH>2Years</TH><TH>Yes</TH></TR> 
<TR><TH>Gold</rH><TH>5 Years</TH><TH>No<yTH></TR> 
</TABLE> 

</BODY> 
</HTML> 
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FIG. lie 



1160 



<HTML> 
<HEAD> 

<TiTLE>Extemal Annotation</TITLE> 

</HEAD> 

<BODY> 

<!- This should be inserted into the HTML Source -> 
1180 

/ X 

<TABLE summary="Added Summary for the table"> 

<TR><TH>Colors</TH><TH>lnteriors</TH></TR> 

<TR><TH>Blue</TH><TH>Cloth</TH></TR> 

<TR><TD>Black</TD><TD>Vlnyl</TD></TR> 

<n"ABLE> 

<B>Warranty</B> 
Restrictions 



</BODY> 
</HTML> 
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FIG. 12 A 
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FIG. 12B 




FIG. 120 
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FIG. 13A 

1300 



<?xml version='1 .0" ?> /1310 

<annot version="1 .0" condition="{(User_Agent=Mozilla/4.*) | 

(User_Agent=Mozilla/5 *)) & !(User_Agent=*MSIE*)"> 

...rest of external annotation file follows... 

</annot> 



FIG. 13B 

1320 



<description take-effect="before" 
target="/HTML[1]/B0DY[1]/*[1]" 
1330 condition="((User_Agent=Mozilla/4.*) | (User_Agent=Mozilla/5.*)) 
&!(User_Agent=*MSIE*)" > 
<remove /> 
</description> 



FIG. 13C 

1340 



<!- 

<?xml version="1.0" encoding="ISO-8859-1"?> 

<annot version="1.0" condition="((User_Agent=Mozjlla/4.*) 

(User_Agent=Mozilla/5.*)) & !(User_Agent=*MSIE*)"> 

<remove/> 
</annot> 
-!> 
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FIG. 14 



1400 



<description take-effect="before" target='7clescendant: : IMG[2]"> 

1410 ] <inserthtml><![CDATA[ <p> Hello World]]></inserthtml> 

</description> 



FIG. 15 



<insertmarkup> 

<![CDATA[<do type="accept" label="Next"> <go href="#Second_Card"/></do> 
</insertmarkup> 
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FIG. 16 



Obtain any applicable external 
annotations 



I 



Send content to device 



1600 



Embed external annotations into 
HTML document as intemal 
annotations 



1610 



Utilize internal annotations to 
modify HTML 



1620 



Transcode HTML to marl<up 
language appropriate for target 
device, processing any hints 
placed by the annotation runtime 



1630 



Perform post-transcoding 
activities (e.g. fragmentation) as 
necessary 



1640 



1650 
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1740 



Insert in DOM 
after n (as a 
following sibling) 



FIG. 17 



Annotation ann= get Next Annotation 



Get XPath and take-effect attribute associated 
with annotation 



NodeList nl = NodeList that the XPath 
represents 



Yes 




1720 



Get next Node n in nl 



Convert annotation into an HTIVIL comment 



Yes 




1705 



Insert before n (previous sibling) 



1750 

"Another node irf^"-- — Yes 
nl? 




Proceed to handle internal annotations 



end 



1710 



1715 



1725 



1730 



1745 



1760 
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FIG. 18 



Upon encountering an 
annotation injected into the 
HTML DOIVl 



For eacii Annotation a 



1800 



1805 




Clear exception 
vector. Set clip 
state to keep 



Clear exception 
vector. Set clip 
state to remove 



Add tag denoted 
in exception 
annotation to 

exception vector 



1815 



1825 



1835 



Process non-clipping related 
annotation 



1840 
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FIG. 19 



Upon encountering a non 
annotation node in tlie 
HTML DOM 



1900 



1905 




Yes 




PerformNodeClipping 




1920 



Yes 



1915 



Continue on to 
next node 



Annotation dipping 
process completed 



1930 
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FIG. 20 



Start of PerformNode 
Clipping 



2000 



2005 




Yes 

> ► 




2010 


Continue on to 






next node 






Replace tag with 
its children in the 
DOM 



2020 



Yes 



Perform specialized 
clipping of this tag 
(removing any dependent 
children nodes as 
appropriate) 



2025 
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FIG. 21A 



Obtain preference value annotation for this 
table 



t 

Create a new comment node that contains 

identifying preamble (e.g. 
"wtp-table-preference") plus the extracted 
table preference key value pair 
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FIG. 2 IB 



Upon encountering a comment with the 
table transcoding preference identifying 
preamble (e.g. "wtp-table-preference") 



2120 




Convert each row of the 
table into a bulleted list 



I 



For each row except the 
first row, prepend the list 

item with the first row, 
column entry A, where A is 
the column from which the 
list item came from 



2140 



Convert each row of the 
table into a bulleted list 



2150 



2160 
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FIG. 22 



Upon encountering an Insert HTML annotation 



I 



I 



2200 



Extract the String of HTML from annotation. Let HS equal 

this String 



2210 



Prepend any necessary HTML preamble missing from HS 
and also postpend onto HS any postamble missing. 



2220 



Use HTML DOM parser to parse extracted HTML String HS 
(plus prepended preamble and postpended postamble) into 
a DOM. Let HS-DOM equal this DOM 



2230 



Remove the preamble and postamble nodes from HS-DOM 
that already exist in the original HTML DOM 



2240 



I 



2250 



Copy HS-DOM into the original HTML DOM 



I ^ RSW920000ie6US1 I ^ 

K. Britton, et al 
Enhanced Transcoding of Structured Docunnents 
Through Use of Annotation Techniques 
32/33 



FIG. 23A 



2300 



Upon encountering an Insert Rendered 
Markup annotation 



2305 



Extract tine String of Rendered IVIarl^up from 
annotation 



Create a new comment node that contains 

identifying preamble (e.g. 
"wtp-rendered-markup") plus the extracted 
String of Rendered Markup 



2310 



Insert New comment node before/after the 
current node in the DOM 



2315 
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FIG. 23B 



Upon encountering a comment with the rendered markup 
identifying preamble (e.g. "wtp-rendered-markup") 
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Extract the String of Rendered Markup from the content. Let 

RIVI equal this String 
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Determine thee ontent-type of rendered markup that 
surrounds this comment by checking the http content-type 
header for the response 



I 
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Determine the appropriate markup preamble and postamble 
based on the content-type. Prepend this preamble onto the 
RMand postpend the postamble 
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Select the appropriate DOM parser for the content type of 

the markup 
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Use selected DOM parser to parse RM (plus prepended 
preamble and postpended postamble) into a DOM. Let 
RM-DOM equal this DOM 
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Remove the preamble and postamble nodes from RM-DOM 
that already exist in the original rendered markup DOM 
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Copy RM-DOM into the original rendered markup DOM 
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